perm filename CHAP7[4,KMC]5 blob
sn#053948 filedate 1973-07-12 generic text, type T, neo UTF8
00100 .SEC MODEL EVALUATION
00200
00300 The primary aim in constructing this model was to explore,
00400 clarify, develop, test and improve a theory having explanatory value.
00500 To satisfy this aim, the model must meet norms of internal
00600 consistency (systemicity) and norms of external correspondence with
00700 observation (testability). A secondary aim would involve pragmatic
00800 norms of application. These aims are not unrelated but the first is
00900 more fundamental since useful applications require some degree of
01000 consistency and authenticity.
01100 As emphasized in Chapter 2, a model in the form of an
01200 algorithm consists of a structure of functions or procedures whose
01300 inner workings are sufficient to reproduce the outward symbolic
01400 behavior under consideration. The theory embodied in the model is
01500 revealed in the set of statements which illuminate the connections
01600 betweeen input and output by describing how the structure reacts
01700 under various circumstances.
01800 What constitutes a satisfactory explanation has been treated
01900 in 2.1. The "fit" or correspondence with phenomena as indicated by
02000 measurements and empirical tests indicate the degree of faithfulness
02100 of the reproduction as described in Chapter 6.
02200 Decision procedures for a consensus acceptability of a model
02300 sometimes depend not so much on truth, an elusive state, as on
02400 whether a majority of the relevant expert community believes the
02500 theory or model to approximate truth to some unknown and unknowable
02600 degree and be better than available plausible alternatives. Empirical
02700 truth or falsity cannot be proven with certainty but their presence
02800 can be assayed by some sort of critical assesment and deliberation.
02900 We can forgive models for being only nearly true. Validation is
03000 ultimately a private experience. A theory or model may bring
03100 cognitive or pragmatic comfort, not because it is TRUE but because it
03200 represents an improvement over its contending rivals. Cognitive
03300 comfort is a type of intellectual satisfaction. Pragmatic
03400 comfort accrues from applications to problems in order to make things
03500 work the way humans want them to work efficiently in practical
03600 contexts of technological action. For the pragmatist a model is a
03700 means to an end; for the theoretician an explanatory model is an end
03800 in itself. It is hoped that this paranoid model will be useful in
03900 understanding one of the mysteries of human conduct, the paranoid
04000 mode and the paranoid "streak" which renders so many susceptible to
04100 idelogical delusions in which others appear as malevolent oppressors.
04200 It is commonly stated that an infinite number of theories or
04300 models can account for the same data of observation. Without
04400 questioning whether "infinite" means indefinitely large or just more
04500 than one, we must allow for rival explanations. For a rival to be a
04600 live and tenable option, it should be truly alternative (not just
04700 saying the same thing in a different way), have an appreciable prior
04800 probability, and be testable.
04900 Although I hold that faithful reproduction, fidelity as
05000 measured by indistinguishability, is a proper and major test for
05100 the adequacy of symbolic models, it would be a bonus if our model
05200 could satisfy the function of making possible new knowledge through
05300 prediction. Like validation, the term "prediction" has many meanings
05400 ranging from forecasts, to prognoses to prophecies to precise
05500 point-predictions such as an eclipse. To predict is to announce a
05600 fact without prior knowledge of it. However one needs knowledge of
05700 the kind of fact expected, the conditions which produce it and the
05800 circumstances under which it will occur. Accurate long-range
05900 predictions characterize the ideal of celestial mechanics. (But even
06000 astronomers, with their isolated and repetitive systems, have their
06100 troubles; Halley's comet in the 18th century arrived four days later
06200 than predicted while in the 20th century it was eight days later!).
06300 Long-range predictions of individual human behavior are difficult
06400 because (1) sufficient knowledge of initial conditions may require
06500 that we know the whole past history of a person- something not yet
06600 achieved, (2) individuals do not remain
06700 isolated over the time stretch of the prediction; they interact with
06800 other individuals of an unknown nature (3) life is a fortuitous flux
06900 of chance intersections of independent causal chains. In one sense
07000 our paranoid model makes moment-to-moment predictions and asserts
07100 new counterfactuals about behavior in a psychiatric interview.
07200 That is, if an interviewer says X under conditions Y, then the
07300 model's response will be characterized by z1...zn. Counterfactual
07400 prediction means that on the basis of observed behavior we are
07500 willing,with an inductive risk, to assume the presence of unobserved
07600 behavior potentials in the model's repertoire of capabilities.
07700 Predicting new kinds of events or properties, instead of
07800 kinds we are already familiar with, would represent a surplus bonus.
07900 It would give both clinicians and investigators something to look
08000 for. This novelty could arise in two ways. First, the model might
08100 demonstrate a property of the paranoid mode hitherto unobserved
08200 clinically. In principle this could come about because the I/O
08300 behavior of the model is a consequence of a large number of
08400 interacting hypotheses and assumptions chosen initially to explain
08500 frequently observed phenomena. When the elements of such a complex
08600 conjunction interact with highly variable inputs they generate
08700 consequences in addition to those they were designed to explain.
08800 Whether any of these consequences are significant or characteristic
08900 of the paranoid mode remains a subject for future study.
09000 It is also possible that a new property of paranoia may be
09100 discovered in the clinical interview, although perhaps everything
09200 that can be said about it has been said. If a new property were
09300 found, a search for it might be conducted in the model's behavior. if
09400 successful, this would add to the model's acceptability.
09500 A second novelty might arise in the behavior of the model in
09600 some new situation. Since it is designed to simulate communicative
09700 behavior in an interview situation, the `new' circumstance would have
09800 to involve some new type of linguistic interaction which the model is
09900 capable of responding to. From its behavior one might then predict
10000 how paranoid patients would behave under similar circumstances. The
10100 requisite empirical tests and measures would show the degree of
10200 correspondence between patient and model behaviors.
10300 This possibility is of importance in considering therapies
10400 for patients tangled in the quandaries of the paranoid mode. Since
10500 the model operates at a symbol processing level using natural
10600 language, it is at this level at which linguistic and semantic skills
10700 of clinicians can be applied. Language-based or semantic techniques
10800 do not seem very effective in the psychoses but they are useful in
10900 states of lesser severity. A wide range of new semantic techniques,
11000 including extremes, could be tried first on the model without
11100 subjecting patients to blind experimentation.
11200 While our group has used the model to explore a theory and to
11300 study psychiatric judgements, its potential use as a training device
11400 has not escaped our attention. Medical students and psychiatric
11500 residents need "disposable patients" to practice on without jeopardy.
11600 The paranoid model can print out a trace of its inner states during
11700 and after an interview. Whether the optimal goal of interviewing
11800 (gathering relevant information without upsetting the patient), has
11900 been achieved, thus can be estimated. A beginning interviewer can
12000 practice in private or with a supervisor present. Many interviewers
12100 have reported that the model has a definite effect on them. The
12200 student can get the feel of the paranoid mode long before he
12300 interviews an actual patient. The effect of various interviewing
12400 styles can be studied and compared.
12500
12600 It should be clear by now that this simulation of paranoia,
12700 while circumscribed in what it attempts to explain, covers a variety
12800 of facts. The explanation is local and restricted in that it accounts
12900 for only one type of symbol-processing mode. Past attempts at grand
13000 scale explanations of all mental processes in all contexts have
13100 failed. We need to build one circumscribed and tested theory or
13200 model at a time so that the field can gradually move forward a step
13300 at a time, each step gaining consensus before attempting the next
13400 step.